Cramer-Rao Bound for Blind Channel Estimators in 
Redundant Block Transmission Systems 

Yen-Huan Li, Student Member, IEEE, Borching Su, Member, IEEE, and Ping-Cheng Yeh, Member, IEEE 



o 



CZ2 

O 



(N 

o 



X 



Abstract — In this paper, we derive the Cramer-Rao bound 
(CRB) for blind channel estimation in redundant block trans- 
mission systems, a lower bound for the mean squared error of 
any blind channel estimators. The derived CRB is valid for any 
full-rank linear redundant precoder, including both zero-padded 
(ZP) and cyclic-prefixed (CP) precoders. A simple form of CRBs 
for multiple complex parameters is also derived and presented 
which facilitates the CRB derivation of the problem of interest. A 
comparison is made between the derived CRBs and performances 
of existing subspace-based blind channel estimators for both CP 
and ZP systems. Numerical results show that there is still some 
room for performance improvement of blind channel estimators. 

Index Terms — Cramer-Rao bound (CRB), blind channel esti- 
mation, block transmission systems, complex parameters, con- 
strained parameters. 



I. Introduction 

Block transmission systems, especially orthogonal 
frequency-division multiplexing (OFDM) systems, have 
become one of the most popular solutions to meet the high 
data rate requirements of modern communication standards. 
For example, wireless local-area networks (WLAN) standards 
such as IEEE 802.1 In J5), and beyond third-generation (B3G) 
cellular communication standards such as IEEE 802. 16e 
J6] or 3GPP-LTE [7|, all apply block transmission schemes 
as the basic physical-layer transmission scheme. Channel 
estimation is crucial for equalization in these systems. Most 
of the modern standards using block transmission systems 
insert some already-known symbols, called pilot symbols, in 
the transmitted signals, and the receiver estimates the channel 
response from the pilot symbols Jg]. Such an approach is 
called pilot-assisted channel estimation method. However, 
pilot assisted methods suffer from loss of bandwidth efficiency 
since the inserted pilot symbols do not carry any information. 

Blind channel estimation in block transmission systems, 
on the other hand, aims to avoid the redundancy introduced 
by pilot symbols. The goal of blind channel estimation is to 
estimate the channel response directly from unknown symbols, 
which can be data symbols Q. Current blind channel estimation 
algorithms can be roughly divided into two main categories. 
The first exploits the fact that all of the transmitted symbols 
come from a set of finite number of points in the signal space, 
i.e., the modulation constellation iflOl . The second assumes 
no a priori information about the modulation constellation 
at the receiver side and consists mostly of subspace-based 
methods [ 1 1 1. This kind of approach can be applied in a wider 

'Theoretically, we only need one pilot symbol to eliminate the scalar 
ambiguity (3). 



range of situations, but may have a slightly worse performance 
than finite-alphabet methods. This paper addresses only the 
performance bound of blind channel estimators assuming no 
a priori information about the transmitted signals. 

Cramer-Rao bound (CRB) is an important performance 
bound which gives a lower bound for the mean squared error 
(MSE) of channel estimators in a communication system [8|. 
A CRB for blind finite impulse response (FIR) multichannel 
estimation has been derived in lfl2l . It is, however, not appli- 
cable for redundant block transmission systems. There are two 
main types of redundant block transmission systems, namely, 
systems with null guard intervals, also known as zero padded 
(ZP) systems, and systems with cyclic prefixes (CP). The 
CRB for blind channel estimators in ZP block transmission 
systems has been derived in HI, 0. But the CRB for blind 
channel estimators in CP block transmission systems, to our 
best knowledge, has not yet been studied in the literature. In 
this paper, a general CRB for block transmission systems is 
derived, which is valid for any linear redundant precoders, 
including those in ZP lfl3l and CP systems. We then compare 
the performances of existing blind channel estimators 0, flU, 
J9], OH with the derived CRB. 

An additional contribution of this paper is a simplification 
of CRB formulas for complex parameters. To calculate the 
CRB for blind channel estimation in wireless communication 
systems, in which numerical values are usually modeled by 
complex numbers, we extend the existing results of CRBs for 
unconstrained and constrained parameters, originally for real 
parameters ifTTl . lfT31 . Ifl6l . to the case of multiple complex 
parameters. We devote one section to do this work before 
starting the derivation of the CRB for the problem of interest. 

There has been some existing literature on this topic ifTHI . 
ED, ESI, ED- In CDD, ED, ED, the derived CRBs for 
unconstrained and constrained complex parameters, unlike the 
corresponding CRBs for real parameters, are variance bounds 
of any unbiased estimators for [ 9 T 6 H ] T e C 2 ™, a vector 
of double size of the unknown parameter vector 6 G C™. 
In EOL a CRB that represents variance bound of unbiased 
estimators for 9 G C™ is presented for the first time. However, 
its result is in a complicated form compared with the well 
known CRB for real parameters [16]. In addition, the result 
in ll20l does not consider constraints on unknown parameters 
and cannot be directly applied in the problem considered in 
this paper. 

Instead of a complicated form, we seek here to derive simple 
CRBs for unconstrained and constrained complex parameters 
in a form similar to those for real parameters. Specifically, 
the form of the derived CRB for unconstrained complex 
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parameters is exactly identical to the CRB for unconstrained 
real parameters; and if the constraint function is holomorphic, 
the CRB for constrained complex parameters can also have the 
same form as that of the CRB for constrained real parameters 
[16|. Using this result, the derivation of CRB for the blind 
channel estimation problem becomes simple and compact 
compared to that in (TJ. 

The rest of the paper is organized as follows. In Section 
HTl we derive simple CRBs for unconstrained and constrained 
complex parameters. In Section [HI] the system model of a 
redundant block transmission system is described and the blind 
channel estimation problem is formulated. We then derive 
the CRB for blind channel estimators in Section |IV] using 
results given in Section [EI] In Section [V] numerical results are 
conducted to compare the derived CRB with performances of 
existing blind channel estimators. Conclusions and future work 
are presented in Section IVII 

Notations 

Bold-faced lower case letters represent column vectors, 
and bold-faced upper case letters are matrices. Superscripts 
such as in v*, v T , v , M^ 1 , and Aft denote the con- 
jugate, transpose, conjugate transpose (Hermitian), inverse, 
and Moore-Penrose generalized inverse of the corresponding 
vector or matrix. The vector vec(TW) denotes the column 
vector formed by stacking all columns of M . The vector E [v] 
denotes the expectation of v, and the matrix E [M] denotes 
the expectation of M. The matrix cov(tt, v) denotes the cross- 
covariance matrix of random vectors u and v and is defined 
as co\/(u,v) = E [(it — E(u))(v — E(v)) H ~\. The Kronecker 
product of A and B is denoted by A g) B. The notation 
A > B means that A — B is a nonnegative-definite matrix. 
The trace of a square matrix A is denoted by tr(A). Matrices 
I n and mx „ denote the n x n identity matrix and the mxn 
zero matrix, respectively. Notations [A)ij and [v]i refer to 
the (i,j)th entry of matrix A and the ith element of vector 
v, respectively. The notation [v] a: b denotes the column vector 
whose elements contain the ath through 6th elements of vector 
v. 

II. Simple Forms of CRBs for Complex Parameters 

In this section, we present an extension of CRBs originally 
for unconstrained and constrained real parameters to the case 
of complex parameters. The CRB for constrained complex 
parameters derived in this section, in particular, will be directly 
used in Section [IV] for CRB derivation for blind channel 
estimators in redundant block transmission systems. 

A. CRB for Unconstrained Complex Parameters 

Suppose that 9 6 C™ is an unknown complex parameter 
vector, and t(y) an unbiased estimator of 9 based on a 
complex observation vector y G C p characterized by a 
probability density function (pdf) p(y; 9). We assume the 
regularity condition is met: 



~dlnp(y;6)~ 


= E 


'dhxp(y;0)' 


de T 




de H 



0. 



(1) 



Here the differentiation is defined according to Wirtinger's 
calculus ll22l that 
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(2) 



for all / : C -> C and z = a + jf3 E C, a, 8 e R. We assume 
p(y; 9) to be real differentiable so that the derivative exists. 
We first define the complex Fisher information matrix (FIM) 
and then give the CRB expression in terms of the FIM as a 
theorem. 

Definition II.l (Complex Fisher information matrix). Suppose 
6 £ <C n is an unknown complex parameter vector and y is 
a complex observation vector characterized by a pdf p(y; 6). 
Then the complex Fisher information matrix (FIM) for y is 
defined as 



dlnp\ f dlrtp 



86* 



89* 



H 



(3) 



Note that the FIM defined above has a size of n x n rather 
than 2n x 2n as in many previous results [181, [19], [21]. We 
then present the CRB expression of unconstrained complex 
parameters in terms of this FIM in the following theorem. 

Theorem II.l. Suppose t(y) £ C" is an unbiased estimator 
of an unknown complex parameter vector 9 € C" based 
on a complex observation vector y (i.e., E [t(y)] = 9 ) 
characterized by a pdf p(y; 9). Then 



cov(M) > J 1 - 
The equality holds if and only if 



(4) 
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Proof: See Appendix A. 



with probability 1. 



B. CRB for Constrained Complex Parameters 

In this subsection we derive the CRB for constrained 
complex parameters with holomorphic constraint functions. 
Although the result is not so general as those in |[T9l . [21 1, 
it is more compact and easy to manipulate. In fact, the form 
of the derived constrained CRB for complex parameters is the 
same as that for real parameters [16|. 

To begin the derivation of complex constrained CRB, we 
need some basic concepts from complex analysis, including 
the definition of a holomorphic map. 

Definition II.2 (Holomorphic map (22]). Let B be an open 
subset of C™. A map f : B — > C m is said to be holomorphic 
if 

df 



8z H 

where z £ C™ is a complex vector. 



0, 



(5) 



As long as the constraints can be expressed as a holomor- 
phic map of complex parameters, the CRB for constrained 
complex parameters exists, as presented in the following 
theorem. 
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Fig. 1. Block diagram of blind channel estimation in a redundant block transmission system 



Theorem II.2. Let t(y) be an unbiased estimator of an 
unknown parameter £ C™ based on observation y 6 C p 
characterized by its pdf p{y\ 0). Furthermore, we require 
the parameter 6 to satisfy a holomorphic constraint function 
/:€"-)■ C"\ m < n, 

f{6) = 0. (6) 

Assume that df/d9 T has full rank. Let U be a matrix with 
(n — m) orthonormal columns that satisfies 

df 



u = o. 



Then 



cov(M) > U (U H JuV U H , 



(7) 



(8) 



where J is the FIM defined as in (0. The equality holds if 
and only if 

t 9 = U (U H JU) 1 U H with probability 1 . (9) 

Proof: See Appendix B. ■ 
With Theorem lII.2l we are ready to derive the CRB for blind 
channel estimators in redundant block transmission systems, 
as shown in the following sections. 



III. System Model and Problem Formulation 

In this section we formulate the blind channel estimation 
problem in a redundant block transmission system using an 
equivalent discrete-time baseband model. 

The block diagram of a block transmission system is shown 
in Figure 1 . Let the nth source block be expressed as an M x 1 
column vector 



s(n) = [ s (n) si(n) ••• s M -i{n) 



(10) 



where each entry in the vector is a modulation symbol 
expressed as a complex value. The vector s(n) is precoded 
by a full-rank M -by-Af matrix F to obtain 



u(n) — Fs(n) 



(11) 



In an OFDM system, F equals to W H , the normalized 
inverse discrete Fourier transform (IDFT) matrix; in a single 
carrier (SC) system, F equals to the identity matrix Im- We 



assume the general case that F is nonsingular as in JT]. For 
convenience we define 



P = M + L. 



(12) 



The precoded M -vector u(n) is then added redundancy to 
obtain a P-vector 

x(n) = Ru(n) 

where R is a P x M full rank matrix representing the type 
of redundancy added. In a cyclic prefix (CP) system, we have 



R 











Lx(M-L) 

Im-l 

Lx(M-L) 



II 
II 



while in a ZP system, we have 
R 



hi 
Olxm 



In general, we have a unified expression for x(n), 
x(n) = RFs(n) = Fs(n) 

where 



F = RF 



(13) 



(14) 



(15) 



(16) 



is a full-rank P X M matrix. Note that ZP-OFDM, SC-ZP, 
CP-OFDM, and SC-CP systems are all special cases of the 
redundant block transmission system considered here. 

After parallel-to-serial conversion, x(n) is sent to the 
channel, modeled as a finite impulse response (FIR) filter 
characterized by its z-transform 



H(z) 



(17) 



The output of the FIR channel is the convolution of the input 
and the channel impulse response. Suppose the transmitter 
sends N consecutive blocks defined as 



s(N- 1) 



T IT 



(18) 



The nth received block, y(n), n = 0, 1, 2, N — 1, can be 
expressed as 



y(n) = H, 



[x{n - 1)] M+1:P 
x(n) 



e(n), 



(19) 
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where Hi is a P-by-(P + L) Toeplitz matrix ||26l of the form 



H 



h L 






hi 







ho 
In 



o 

h 



hi 





h 



(20) 



and e(n) is the additive white Gaussian noise (AWGN) at the 
receiver side with zero mean and covariance matrix 



E[e(n)e H {n)] = a 2 I P . 



(21) 



Notice that, for n = 0, the values of the first L entries 
of y(0) depend on undetermined vector x(— 1). So for the 
channel estimation problem, we drop these L samples from 
the observation and use only the last M samples of the 0th 
block y(0), which can be expressed as 



[y(o)] 



L+l-.P 



H 2 x(0) + e(0) 



(22) 



where H 2 is an M x P Toeplitz matrix of the same form as 
Hi in d20l >. Collect the (NP — L) samples observed by the 
receiver and define the observation vector as 



vn ± [ [v(p)E+i:p viX? 



y(N~l) T } 



T ]T 



Then it can be shown, from (fT5] l, fl9\ , and ( f22l . that 
y N = GH(I N <8) F)s N + e N 

where 



(23) 



(24) 



G = [ 



(NP-L)xL I(NP-L)x(NP-L) O(JVP-LxL) J i 



(25) 



is a (NP + L)-by-NP Toeplitz matrix of the form 



H 4 












... 

'•. 

'■. h 

••. /n 

h L 



(26) 



and the (A^P — L)-vector e^r is defined as 

e N ^[ [e(0)]L. liP e(l) T ... e(iV-l) T f. 



(27) 



The product of matrices G and if defined above is actually 
equivalent to a matrix in a "fat" Toeplitz form as in (l20l >. The 
reason we use this seemingly more complicated expression 
here is for convenience of CRB derivation, as will be shown 
later in the next section. 

Now, the goal of blind channel estimation in a redundant 
block transmission system is to estimate 

h=[Ao hi ... h L ] T (28) 

from the observation defined in d23l and (124-b . 

Although the problem studied here considers block trans- 
mission systems with all kinds of linearly redundant precoding 



including ZP systems, it should be noted that even when R 
is taken as the form in (fl4l . the problem is slightly different 
from that defined in fT) due to the fact that the first L entries 
of y(0) are not taken as part of the observation vector y^. 

IV. CRB for Blind Channel Estimators 
We define the (NM + L + l)-fold parameter vector 9 as 



0±[h q 



N 



(29) 



where sn is treated as a nuisance parameter ll2Tl . To derive 
the CRB for blind channel estimators, we first identify the 
probability density function of the observation vector y^ given 
and calculate the complex Fisher information matrix (FIM) 
J defined in (|3j- Then we apply Theorem III. 21 to obtain the 
CRB expression in terms of F, h, and s^r. 

By the assumption of additive white Gaussian noise, the 
probability density function of the receiver's observation given 
9 is 



P(VN]d) 



(ttct) 



7-rCxp ( — \ \\y N - GH(I N <8> F) s N \\ 



NP-L 



The Toeplitz matrix H can be rewritten as 

L 



H = Y J hiJ u 



where the («, j)th element of J; is defined as 

1, Mi- 3 = 1 



Jl]i,j — 



0, otherwise 



, l = 0,l,...,L. 



(30) 



(31) 



(32) 



In the following derivations, for simplicity, we will use K 
and K u I = 0, 1, L, to represent K = GH(I N ® F) and 
Ki = GJi{I N ® F),l = 0,1, respectively. Note that 

K = Yli=ohiKi- To calculate the FIM J, we take partial 
derivatives on the logarithm probability density function with 
respect to elements of 9 and obtain the following equations. 



<91np 

dh* 



: —s^ilN^F^J^G" 
[y N -GH(I N ®F)s N ] 



dlrip f d\n.p 



dhi 
dlxip 



dh* 



(33) 



(34) 



1 



(I N ® F) H H H G H 



N 



[y N - GH(I N <g) F)s N ] 



dlxip ( dhip 



ds 



N 



ds 



N 



(35) 
(36) 
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Now, divide J into 4 sub-matrices 





fd\np\ H ~ 




Jo,o Jq.i 


^ de* ) 


\ de* ) 




Jl,0 1,1 



The entries of these sub-matrices can be written as 

dhip dlap 



[Jo,OH,j 
[Jo,i\i,j 
[Ji,o]i,j = E 



- E 



dh* dhj 
dlap dhip 



dh* d[s N ]j 
dhip dhip 



and 



[Ji. 



d[s* N ]i dhj 



dhip <91np 



(37) 

(38) 
(39) 
(40) 

(41) 



_d[s* N ]i d[s N ]j. 

respectively. By equations ( |33l [34l |35l [36] l and the fact that 
E[ejvefJ] = <t 2 Inp-l, we have the following results. 
1) For the sub-matrix Jq,o : 



[yo,o]i,; 



sa%K?K 4 s 



jS N . 



Therefore, we can write Jo o as 



Jq,0 



,H K H 



r *h k h 



L S N JX L 



H 



(42) 



(43) 



2) For the sub-matrix Jq,i, the ith row of «7o,i is 
<91np / <91np T 



ds 



N 



Therefore, 



Jo, 



- —« H K H K 



* H K H K 



s H N K*K 



(44) 



3) For the sub-matrix Ji.o, we have 

J%,0 = «/ofi- 

4) For the sub-matrix Ji,i, we have 
dhip ( dhip 



ds 



N 



ds 



N 



H 



= —KK 



= E 

Since = [h T s T N ] T and 6>' = [ (l/c)h T cs% } 



(45) 



(46) 



(47) 



T IT 

AT J 

will result in the same observation vector y for any nonzero 
c G C, an unbiased blind channel estimator will not exist. 
This is commonly known as the scalar ambiguity issue and is 
usually resolved by setting one element in 6 as already known 
0]. Here we follow the approach in [1] that we assume the 
dth element of h, hj,, is nonzero and already known to the 
receiver. In the perspective of CRB for constrained parameters, 
this assumption corresponds to the constraint function 



f(0) 



h° 



(48) 



where /i" is the realized value of hd- Obviously / is a 
holomorphic map. We can then apply Theorem lH.2l and obtain 
the CRB with the constraint function / as 



cov(6,e)>E' d H (E' d JEf) 



(49) 



where E' d is obtained by removing the e?th row of Inm+l+i, 
the identity matrix of order (NM + L + 1) (Note that E' d 
satisfies (Q). All elements on the <ith row and dth column 
of (|49l are zero, implying the dth parameter, h d , always has 
a zero MSE, consistent with the fact that the receiver has a 
priori information h d = h d . Therefore we ignore the dth row 
and column of (l49l and only consider the covariance bound 
for estimators of 6 d = [ho, ■ ■ ■ , h d -i, h d+1 , . . . , h L , s^] T , 
(i.e., (E' d JE' d H ) ) in the following discussion. Let J = 
E' d JE' d H . Then the matrix J is of the form 



EdJofiE d E d J 0y i 



(50) 



where E d is an L x (L + 1) matrix obtained by removing the 
dth row from Il+i- Then, equation (l49l implies that for any 
unbiased estimator 6 d of 6 d , 



e d , e d > j 



(51) 



Since we only focus on the performance of channel estimators, 
we can simplify the above equation to obtain a bound for 
cov(h d) hd), where h d = [h , h d -x, h d+1 , h L }. This can 
be done by noting that ( BTT l implies 



>L x NM 



] cov [8 d ,e d 



u LxNM 



> 



[ II Olxnm ] J 



u LxNM 



(52) 



The left side of the inequality corresponds to the covariance 
matrix of h d . Therefore, the CRB for any unbiased estimator 
h d , of h d , can be calculated as the upper-left L-hy-L sub- 
matrix of J r_1 : 



Ccrb — [E d (Jo,o - Jq,i Jl t l Jo,i) Ed] 



(53) 



From Appendix |C] we obtain the final form of the CRB for 
blind channel estimation in any given redundant block trans- 
mission systems, as shown in (l54l . in terms of h, sn, d, and 
F. In (O, the matrix U has a size of (L + 1) x LPN(N - 1) 
and can be determined by vector h and matrix F. The 
values of nonzero entries of U all come from the (N — 1)L 
orthonormal left annihilators of K — GH(In Cg> F) and are 
defined in details in ([87). 

Although the CRB considers all LRR including ZP systems 
(i.e., F satisfies (fT6]i(fl4li). the CRB expression in dBU i does 
not reduce to that obtained in (T), (2) in this situation. The 
reason is that in the derivation of this CRB, we do not use 
the first L entries of the first block as part of the observation 
vector. In fact, as will be shown in Section [V] with a smaller 
observation vector, the CRB values derived here are expected 
to be slightly higher than those derived in (T), J2]. 
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C CRB (fc, s N , F, d) = a 2 (E d U {/ (JV -i)£ ® [(/at ® F)'a^fl^(Jjv ® F) T ] } W ff «f 



(54) 



TABLE I 

Simulation Settings for CP Systems 



M=12, N=25, L=4, SC-CP, #Ch=500, #S=30 



Block size M 


12 


Number of received blocks N 


8, 25, 50 


Channel order L 


4 


Modulation 


QPSK 



V. Numerical Results 

In this section we first compare the performance of existing 
blind channel estimation algorithms for CP systems with the 
CRBs derived in this paper. The subspace-based blind channel 
estimators proposed in J3), l?l are chosen as benchmarks. 

The simulation settings are concluded in Table U The 
simulation results are averaged over N c h — 500 independent 
channel realizations. All elements in the ith realization of h, 
defined as h (i) = [ f$ ■■■ h$ }, are generated 

first as independent complex Gaussian random variables with 
zero mean and unity variance and then normalized to satisfy 
||/iW|| 2 = 1. For each channel realization, N s = 30 trials 
with independent sets of QPSK modulated data symbols are 
conducted to further average the channel estimation MSE, 
defined as: 



MSE 



1 



N ch N t 



N ch N s 
i=l 3=1 



(55) 



where hS l 'i' is the estimate of the ith channel realization in the 
jth trial, and dj, is chosen as the index of the channel tap with 



the maximal power: di — axgmaxo<d<z 
the CRB curves are calculated according to 



(0 



. Similarly, 



CRB = 



1 



N ch N t 



(56) 



= 1 3=1 



with the same channel and data set realizations. 

We first consider the blind channel estimation problem in 
SC-CP (F = Im, R is chosen as in (foi l) systems with 
25 received blocks available. The performance of algorithms 
proposed in [3| and [9], as well as the CRB derived in this 
paper, are depicted in Figure [2] We can see the algorithm in |]3] 
has advantage over that in J5] in high-SNR region while the 
algorithm in [9| has better performance with a low SNR. As 
predicted in [3|, increasing the algorithm parameter Q from 3 
to 5 gains a slight MSE improvement in high SNR region but 
results in a large performance degradation when SNR is low. 
Under high SNR values, for both curves of algorithms [3 1, the 
gap between the simulation MSE result and the CRB, tends to 
approach a constant in log scale (around 3 to 4 dB in SNR). 
All these MSE results do not achieve the performance lower 
bound suggested by the CRB. 



-CRB 

- Simulation [9] 

■ Simulation |3] with Q = 3 

■ Simulation [3] with Q = 5 




15 20 25 
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Fig. 2. CRB and simulatoin results for SC-CP system with 25 blocks 



M=12, N=25, L=4, CP-OFDM, #Ch=500, #S=30 



- CRB 

- Simulation [9] 

- Simulation |3] with Q = 3 

- Simulation |3] with Q = 5 
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Fig. 3. CRB and simulatoin results for OFDM-CP system with 25 blocks 



Figure [3] considers CP-OFDM systems (i.e., F = W H )with 
the same simulation settings. The performance curves are al- 
most identical to those in Figure |2] This suggests the precoder 
F does not significantly affect the MSE and CRB curves 
for blind channel estimators in CP systems. All following 
simulations will then consider single carrier systems only. 

In Figure|U we consider the problem in SC-CP systems with 
50 received blocks. The MSE and CRB curves are all lower 
than those in previous plots. The gaps between the CRB and 
MSE results still converge to constant values in log scale in 
the high-SNR region. For both curves of algorithm [3 |, the 
gap is around 3 dB; for algorithm [9 |, it is around 5dB. 

The case with only 8 available received blocks is studied in 
Figure [5] As algorithm in [9 1 does not work appropriately with 
such a small amount of received data, only performance curves 
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Fig. 4. CRB and simulatoin results for SC-CP system with 50 blocks 
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Fig. 5. CRB and simulatoin results for SC-CP system with 8 blocks 
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Fig. 6. CRB and simulatoin results for SC-ZP system 



observe that performance in the high-SNR region improves 
when the algorithm parameter Q is chosen as a large value. 
But the improvement slows down gradually as Q increases to 
10. Similarly, it results in performance degradation with low 
SNR values. For the high SNR region, in the best situation 
shown (Q = 10), the gap between the MSE performance and 
the CRB is around 4 to 5 dB in high SNR region. 

We now turn our attention to ZP systems (i.e., F satisfies 
{SO). We compared the derived CRB, CRB reported in 
HI, EL an d MSE performances of existing blind algorithms 
|4|, |14| in Figure [6] In Figure [6] our CRB is slightly higher 
than that reported in JT], 0, with a margin of less than 0.5dB. 
This is consistent with the fact that the first L entries of 
the first block are dropped from the observation vector (as 
stated at the end of Sections Hill and [TV] ). This discrepancy in 
two CRBs, however, is much smaller than the gap between 
MSE performances of existing algorithms and the CRBs. The 
generalized algorithm in [4] has a performance gap to the CRB 
of around 2 dB in high SNR region. The performance curve of 
an earlier method in lfl4l is around 7dB from the CRB bound. 

Summarizing all above simulation results, in both CP and 
ZP systems, all existing blind channel estimation algorithms 
1 9 1, [3, lfl4l . dH do not achieve the lower bound suggested by 
CRB. In the high-SNR region, the generalized subspace meth- 
ods proposed in [4| [3| obtain the best performances among 
others, regardless of the number of available received blocks. 
But a gap of around 2 to 4 dB from the best performance to 
the CRB is constantly present, suggesting there is still room 
for performance improvement of blind channel estimators in 
these systems. 

VI. Conclusions and Future Work 

In this paper, we derived the CRB for blind channel esti- 
mators in redundant block transmission systems. The derived 
CRB is valid for any full-rank linear redundant precoder 
(LRP), including both ZP and CP systems and is an extension 
to the result in JT], Q. We compared the derived CRB with 
the performances of the existing subspace-based blind channel 
estimators for CP 0, (5] and ZP systems 04], 0]. Numerical 
results show that these existing blind channel estimators for 
ZP and CP systems do not achieve the CRB and there is still 
some room for performance improvement. 

In addition, a simple form of CRB formula is derived 
for unconstrained and constrained complex parameters. We 
extended this form, originally for real p ammeters 11151 . 11161 . 
ifm . to the case of multiple complex parameters. The results 
not only facilitate the derivation of CRB for the blind channel 
estimation problem of interest, but also are expected to be 
useful for other complex CRB derivations. 

In the future, there are a few research directions worthy 
of being explored. The CRB derived in this paper is ap- 
plicable to blind channel estimators which do not have a 
priori information about the transmitted sig nalfl It would 
be desirable to derive the CRB for blind channel estima- 
tor that assume some stronger assumptions about the trans- 
mitted signals. For example, the receiver should know the 



of algorithm in [3 |, with large values of Q, are presented. We 



2 We ignore the pilot symbol required to eliminate the scalar ambiguity here. 



s 



modulation scheme the transmitter uses, which corresponds 
to the finite alphabet assumption ifTUll . One possible ap- 
proach for this is to use the CRB for constrained com- 
plex parameters. Take quadrature phase-shift keying (QPSK) 
for example. The finite-alphabet assumption that QPSK is 
used can be modeled by setting the constraint function 
as f{9) = [ So (0) 4 Sl (0) 4 ... SM -i(iV-l) 4 ] T - 
[1 1 ... 1 ] T , assuming each modulation symbol has 
unit power. It is obvious that / is holomorphic, so Theorem 
III.2l can be applied. This approach, however, cannot be directly 
extended to more complex modulation schemes such as 16- 
quadrature amplitude modulation (16-QAM). And this will 
require additional research efforts. 

Furthermore, the receiver may, in additional to the modula- 
tion scheme, also know the joint probability distribution of the 
transmitted symbols. The CRB for this case, at first glance, 
can be derived by Bayesian Cramer-Rao bound (BCRB), or 
Van Trees inequality 1171 . Il28l . BCRB is a lower bound of 
variance for all estimators knowing the a priori distribution 
of the unknown parameters. The BCRB, however, cannot be 
applied to discrete parameters, such as modulation symbols. 
An extension of the original BCRB formula to discrete pa- 
rameters or a new bound for such cases is desirable. 

Appendix A 
Proof of Theorem III.1I 



In order to prove Theorem III. II we apply the following 
lemma analogous to the well-known Cauchy-Schwartz in- 
equality, which can be considered as the Cauchy-Schwartz 
inequality for random vectors. Although this lemma has been 
already proved in 03], ll23l . we show the proof here because it 
helps illustrate the necessary and sufficient condition of when 
the equality of CRB holds. 

Lemma A.l. For any two random vectors x, y £ F", where 
F can be R or C, 

cov(y, y) > cov(y,x)cov(x,x)' l co\/(x,y). (57) 

Proof: The proof presented here is from [[23 0- Define 

En = cov(a;, as), E i2 = cov(a3, y), 
2i = cov(y, x), E 22 = cov(y, y). 

Define a random vector z = y — S^iSj^cc, then we have 

cov(2,z) = E 22 - E 2X (s^Eg - EaiE^Eia (59) 

+ E 2 iEJ 1 Eh {^Al\ ^21 
= S 22 - E 2 iE| 1 Ei 2 . (60) 



A H V and 



The second equality follows by [A 1 
A'lA' = for any matrix A. 

The lemma follows since any covariance matrix is nonneg- 
ative definite. ■ 

3 The theorem in 1231 is stronger than the version presented here since it 
allows the Moore-Penrose generalized inverse to be substituted by generalized 
inverse 1241 . 



Now we are ready to prove Theorem III. 11 a CRB for 
unconstrained complex parameters. 

Proof of Theorem III. II 

Proof: Since t is an unbiased estimator, 

E [t{y)\ = 9. (61) 

Differentiate both sides with respect to 9 T , we can get 



equivalently, 



^y)^§r d y = I n 



dy = I n 



With the regularity condition we can rewrite 

dhip 



cov 



89* 



(62) 
(63) 

(64) 



Now, substitute x and y in d57l > by (dlnp) / '(89*) and t, 
respectively, we have 

cov (f , t) 

( 91np\ / d\np d\np\^ ( <91np x H 
> cov t, „„ I cov I „ „ . , ^rrr— I cov I t, 



= cov 



80* J V 99* 
d In p d In p \ 

89* 'He* 



89* 



89* 



8h\p\ ( dlnp 



89* 



89* 



H 



(65) 



The first equality follows by (l64l . and the second equality 
follows by the regularity condition. 

As for the necessary and sufficient condition of the equality, 
from the proof for Lemma |A. II we have cov(;z, z) = if and 
only if z = c with probability 1 for some constant vector c, 
that is, 



t J 



I dlnp 



89* 



— c. 



(66) 



Taking expectation on the both sides of the equality, by the 
regularity condition, we have 



E[t] 

Since t is unbiased, c = 9. 



(67) 



Appendix B 
Proof of Theorem III. 21 

To prove Theorem III. 21 we first derive some lemmas for 
holomorphic maps. First of all, the lemma of implicit functions 
is presented below. 

Lemma B.l. Let BcC"x C m be an open set, f : B -> C m 
a holomorphic map, (zq, Wq) S B a point with f(zo,Wo) = 
0, and 

det ( ^ -Az ,w )) ? 0. (68) 

\o[wi, . . . ,w m \ J 

Then there is an open neighborhood U = V x U" C B and 
a holomorphic map g : U' — > U" such that 

{(z,w) ef/'x U" : f(z,w) = 0} = {(z,g(z)) : z e U'}. 

(69) 
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D = — {Il+i ® x"} [ vec(Wo) . . . vec(^ (A r_i) L _i) ] [ vec(U ) 



vec(W (JV -i)i,-i) ] H ®x n }. (83) 



D = — 

a 1 



vec (x%U 



vec (a:^(7v-i)L-i) vec (^w^o 



vec ( x^Vl {N _ 1)L _ 1 



H 



(84) 



Praq/:- See El. ■ 
Now consider the case where the possible values of 9 is 
constrained to a set 6 = {9 G C" : f(9) = 0} defined by 
a holomorphic constraint function / : C" — > C m , m < n. 
Available observation is y G C p with pdf p(y; 9). The goal 
here is to derive the CRB for any unbiased estimator t(y) of 
9. Note now the unbiasedness refers to 



e [%)] = e 



(70) 



for all 6 G instead of the whole C" . Assume df /89 T has 
full rank for all 9 G so Lemma IbTTI applies. Then, we have 
the following lemma. 

Lemma B.2. Let t{y) be an unbiased estimator of 6 for all 
6 G 6. Then 



(t-o) 



d\np(y;6) 



86 1 



5 = 6 



for all 9 G O, and S such that 
df 



d0 T 



8 = 0. 



(71) 



(72) 



Proof: Follow the derivation of 11251 Theorem I]. Note 
that the implicit function theorem and chain rule hold for 
holomorphic constraint functions 11221 . ■ 
And a corollary immediately follows. 

Corollary B.l. Choose a matrix U with orthonormal columns 
such that 

df 



Then 



[t-e 



d 0T U - 

d\np(y;8) 
d0 T 



u = u. 



Proof: Note that every column of U satisfies ( f72l . 



(73) 



(74) 



Now we are ready to prove Theorem III. 21 

Proof: Substitute x and y in (|57]) by U H (d hip)/ (89*) 
and t, respectively. Then apply Corollary IB. II to simplify the 
equation. As in the proof for Theorem III. II the equality holds 
if and only if 

t-U( U H JU) f U H = c with probability 1 (75) 

for some constant vector c. Taking expectations on both sides 
of d75l l and we have c = 9. ■ 



Appendix C 
Proof of CRB 

In this appendix, we show how to derive the CRB from 
d53| to the final form <E3). Define A = J ,i J^ 1 J^ x . Then, 
using equations d45t and d47l ). the (i, j)th element of A can 
be calculated as 



1 



[Akj =—s%Kf KK* Kjs 



N- 



(76) 



Define D = Jo.o — Jq,iJ\ \Jai- Then we have, by d43l and 
(EE 



\D] 



; S %K? (l NP _ L -KK^)K jS 



N ■ 



(77) 



By assumption, F is a full-rank matrix, and thus F is a full- 
column-rank matrix. The singular value decomposition (SVD) 
of the matrix K = GH(Im <8> F), therefore, is of the form 



K = GH(I N ®F)=[U U } 



S 




V 



H 



(78) 



in which the matrix U represents the null space and has a size 
of (NP - L) x (NL - L). Now, we have 

I NP _ L -KK^ = UU H 1 (79) 

and we can rewrite [D]i,j in d77l i as 

[D]i t j = ^-x%JXG h U(GU) h J iXn (80) 

where 



(T 2 



x N = s%(I N ® F) H 



(81) 



is the vector containing precoded transmitted symbols. Now, 
we can express D as 

H 



D 



1 



(I 



L + l 



(Ei x 



J»G H U 



J*G H U 



J»G H U 



J*G H U 



(82) 



• (I L+1 ® x N ) . 
Define the Hankel matrix 



U 3 = 



u j 

U l,3 



U 1J 



UPN-I,j UpN,j 



u L,j 
u L+l,j 



UpN+L-l,j 



(83) 



where Uij denotes the (i,j)th element of the matrix G H U. 
Notice that u itj = for < i < L - 1 and PN < i < 
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PN+L — l due to the structure of matrix G. The matrix D can 
then be written as in ([83J. Noting that (B T ® A) vec (X) = 
vec(AXB) for any three matrices A, B, and X |26|, we 
have d84b . Since x^Ui is only a row vector for all i, the 
above equation is equivalent to 



N 



U T -r* 
-JA (I(N-I)L 



•■ L4 {N-1)L-1 U 'N 
M(N-1)L~1 X *N S *N 



l(N-l)L 



H 



'N. 



U 



H 



where 



U (N-l)L-l 



(86) 
(87) 



Using the fact that (A® B) = A T $ 
further simplify the expression for D as 

1 



B 



D = —U [l (N _ 1)L ® (x* N x T N )] U H . 



(88) 



Finally, substituting (l88l into (l53l ) and using (18 It . we get 
the final form of the CRB for blind channel estimation in 
redundant block transmission systems, as shown in 
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